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NETWORKED SYSTEM FOR INTERACTIVE COMMUNICATION 
AND REMOTE MONITORING OF INDIVIDUALS 

PRIORITY CLADVl 

This application is a continuation-in-part of USAN 09/237,194, filed January 26, 
1999; which is a continuation of USAN 08/481,925. filed Jime 7, 1995, Patent No.' 
5,899,855; which is a continuation of USAN 08/233,397, filed April 26, 1994, 
abandoned; which is a continuation-in-part of USAN 07/977,323, filed Noveniber 17,' 
1992, Patent No. 5,307,263. 

FIELD OF THE INVENTION 
The present invention relates generally to communication^systems for remote 
monitoring of ■ individuals, and in particular ,o a networked system for remotely 
monitoring individuals and for connnunicating infonnation to the individuals through the 
use of script programs. 



25 



BACKGROUND OF THE INVENTION 
hi the United States alone, over 100 million people have chronic health 
conditions, accounting for an estimated S700 billion m annual medical costs. In an effort 
to control these medical costs, many healthcare providers have initiated outpatient or 
30 home healthcare programs for their patients. The potential benefits of these programs are 
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particularly great for chronically ill patients who must treat their diseases on a daily basis. 
However, the success of these programs is dependent upon the ability of the healthcare 
providers to monitor the patients remotely to avert medical problems before they become 
complicated and costly. Further, success requires compliance with the program, which is 
5 often dependent on providing messages or other reminders to patients so that they will 
stay with the program. Unfortunately, no convenient and cost effective monitoring 
system exists to accomplish these objectives. While these problems are particularly acute 
for the poor and the elderly, all demographic groups could significantly benefit fi-om 
remote communication and monitoring systems. 
10 Prior attempts to monitor patients remotely have included the use of personal 

computers and modems to establish communication between patients and healthcare 
providers, either directly or via an Internet site. However, computers are too expensive to 
give away and the patients who abeady own computers are only a fraction of the total 
population. 

15 Other attempts to monitor patients remotely have included the use of medical 

monitoring devices with built-in modems. Examples of such monitoring devices include 
blood glucose meters, respiratory flow meters, and heart rate monitors. While these 
devices can be quite successful, their multimedia capabilities are often limited, hi 
addition, many patients simply may prefer to interact with a device they are more famihar 

20 with, such as a television. 

Prior attempts to monitor patients remotely have also included the use of 
interactive telephone or video response systems. Such interactive systems are disclosed 
inns. Pat. No. 5,39.0,238 issued to Xirk et al. on Feb. 14, 1995, U.S. Pat. No. 
5,434,611 issued to Tamura on Jul. 18, 1995, and US. Pat. No. 5,441,047 issued to 

25 David et al. on Aug. 15, 1995. One disadvantage of these systems is that they either 
require a patient to call in to a central facility to be monitored or require the central 
facility to call the patient according to a rigid monitoring schedule. 

Kthe patients are required to call the central facility, only the compliant patients 
will actually call regularly to be monitored. Non-comphant patients will typically wait 

30 until an emergency situation develops before -contacting their healthcare provider, thus 
defeating the puipose of the monitoring system. If the central facilit>' calls each patient 
according to a monitoring schedule, it is intrusive to the patient's hfe and resistance to the 
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momtoring grows over time. Further, it is difficult to idcnUfy each patient uniquely using 
these systems. Moreover, these systems are gemally incapable of coileoting medical 
data from monitoring devices, suoh as Wood glucoBe meters, respiratoiy flow meters, or 
heart rate Hionitors. 

As such, there exists a need for a simple and inexpensive system for remotely 
mowtormg patients and for easily communicating infomiation to the patients. There ia 
also a need to encourage patient's compliance with a prescribed treatment pJan. 

SUMMARY 

ThB present, invention provides a system for remotely interacting with an 
individual. The system includes a server, a remote mlerface device for assigning in the 
server a- set of queries to bo answered by the individual, a remotely programmable 
apparatus foir imeraoting with the individual and a broadcaster in commmncation widi the 
server and the remotely programroable apparatus. 

By using the entertainment medium of interactive television with its abiKty to 
receive a large bandwidth of data, the present invention can more easily communicate 
mterafctive entertaining/educational information to potential and existing patients. The 
interactive nature, of the received data makes it easy for a user to access interactive 
programs related to corresponding entectainment/advettiEement content or related to user 
20 adherence to a predefined regimen, 

In accordance with another aspect of the present bivention, an answering service 
sends a series of questions as voice coiumunication from a stored set of questions to the 
remote apparatus for the individual to respond to, when the voice connnunication button 
is activated. The answering service stores responses to each provided questioii in the 
series of questions and provides a service based on die individual's response to the 
questions. The provided service is communication with a health care professional or a 
service provider. Also, the answering service inchules a speech recognition componem 
for receiving spoken responses to the series of questions and a speech synthesis 
component for making the set of queries into a series of questions. 

In accordance with yet another aspect of the present invention, the remotely 
programmable apparatas includes an appliance component for providing appliance 
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functionality. The appliance component is an alam clock, a kitchen appliance, or an 
entertainment device. 

In accordance with still another aspect of the present invention, the remotely 
programmable apparatus includes a monitoring component for producing measurements 
of a physiological condition of the individual. 

BRIEF DESCMPTION OF THE DRAWINGS 
The foregoing aspects and many of the attendant advantages of this invention will 
become more readily appreciated as the same becomes better understood by reference to 
the following detailed description, when taken in conjunction with the accompanying 
drawings, wherein: 

FIGURE 1 is a block diagram of networked system fonned in accordance with a 
first embodiment of the present invention; 

FIGURE 2 is a block diagram ilJustrating the interaction of the components of the 
system of FIGURE 1; 

FIGURE 3 is a perspective view of a remotely programmable apparatus of the 
system of FIGURE 1; 

FIGURE 4 is a block diagram illustrating the components of the apparatus of 
FIGURES; 

FIGURE 5 is a script entry screen according to the preferred embodiment of the 
invention; 

FIGURE 6A is a listing of a sample script program according to the preferred 
embodiment of the invention; 

FIGURE 6B is a continuation of the listing of FIGURE 6A; 

FIGURE 7 is a script assignment screen according to the preferred embodiment of 
the invention 

FIGURE 8 is a sample query appearing on the apparatus of FIGURES 1 A-D; 

FIGURE 9 is a sample prompt appearing on the display of the apparatus of 
FIGURE 3; 

FIGURE JO 

» w^o|yjt*j,v.u a wuiKsiaiion oi me system ol 

FIGURES JA-D' 
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FIGURE llA is a flow chart illustrating the steps included in a monitoring 
application executed by the server of FIGURES 1 A-D according to the present invention; 
FIGURE IIB is a continuation of the fiov/ chart of FIGURE 1 1 A 
FIGURE 12A is a flow chart illustrating the steps included in the script program 
5 of FIGURES 6A-6B; 

FIGURE 12B is a continuation of the flow chart of MGURE 12; 
FIGURE 13 is a perspective view of a remotely programmable apparatus 
according to an embodiment of the present invention; 

FIGURE 14 is a sample prompt appearing on a display of the apparatus of 
10 FIGUEE13; 

FIGURE 15 is a block diagram illustrating the components of the apparatus of 
FIGURE 13; 

FIGURE 16 is a schematic block diagram illustrating the interaction of the server 
of FIGURES 1 A-D with the apparatus of FIGURE 3 according to another embodiment of 
15 the present invention; 

FIGURE 17 is a first sample message appearing on the display of the apparatus of 
FIGURE 3; 

FIGURE 1 8 is a second sample message appearing on the display of the apparatus 
of FIGURE 3; 

20 FIGURE 1 9 is a script entry screen according to an embodiment of the present 

invention; 

FIGURES 20 and 21 are block diagrams of alternate embodiments of the present 
invention; 

FIGURE 22 is a flow chart illustrating the process performed by the system of 
25 FIGURES 21; and 

FIGURES 23 and 24 are example broadcast programming presentations with an 
included script program. 

DETAILED DESCRIPTION 
30 The present invention provides a system and method for remotely monitoring 

individuals and for increasing individual use of health programs. In a first embodiment of 
the invention, the individuals are patients and the system is used to collect data relating to 

. - 5 - 
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the health status of the patients. However, it is to be understood that the invention is not 
limited to remote monitoring of patients. The system and method of the invention may be 
used for any type of remote monitoring and program adherence application. The 
invention may also be implemented as an automated messaging system for 
5 communicating information to individuals, as will be discussed in an alternative 
embodiment below. 

A first embodiment of the invention is illustrated in FIGURES lA and 2-12. 
Referring to FIGURE 1, a networked system 16 includes a server 18 and a workstation 20 
connected to the server 18 through a communication network 24. The server 18 is 

10 preferably a world wide web sender and the communication network 24 is preferably the 
Internet. It will be apparent to one skilled in the art that the server 18 may comprise a 
single stand-alone computer or multiple computers distributed throughout a network. The 
workstation 20 is preferably a personal computer, remote terminal, or web TV unit 
connected to the server 18 via the Internet. The workstation 20 functions as a remote 

15 mterface for entering in the server 18 messages and queries to be communicated to the 
patients. 

The system 16 also includes multiple remotely programmable apparatus, such as 
first and second apparatuses 26 for monitoring multiple patients. Each apparatus 26 is 
designed to interact with a patient in accordance with script programs received from the 
20 server 18. Each apparatus 26 is in communication with the server 18 through the 
communication network 24, preferably the Internet. Alternatively, each apparatus 26 may 
be placed in commimication with the server 18 via wireless communication networks, 
cellular networks, telephone networks, satelhte networks or any other network which 
allows each apparatus 26 to exchaage data with the server 18. It is to be understood that 
25 the system 16 may include any number of remotely programmable apparatuses for 
monitoring any number of patients. 

In the prefenred embodiment, each patient to be monitored is also provided with a 
monitoring device 28. The monitoring device 28 is designed to produce measurements of 
a physiological condition of the patient, record the measurements, and transmit the 
measurements to the patient's remotely programmable apparatus through a standard 
connection cable 30. Examples of suitable monitoring devices 28 include blood glucose 
meters, respiratory flow meters, blood pressure cuffs, electronic weight scales, and pulse 
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rate monitors. Siich mcmitoring devices are well known in the art The spedflc type of 
liiojwtoring device 28 provided to each patient is dependent upon the patienVa disease or 
health treatment needs. For example, diabetes patients are provided with a blood gbcose 
meter for measuring hlood glucose concentrations, asthma patients are provided with 
respiratory flow meters for measuring peak flow rates, obesity patients are provided with 
weight scales, etc, 

FIGURE 2 shows the server 18, the Workstation 20, and the apparatus 26 in 
greater detaU. The ser/er 1 8 includes a database 38 for storing script programs 40, The 
script programs 40 are executed by each apparatus 26, to communicate queries and 
messages to a patient, receive responses 42 to the queries, collect monitoring device 
measurements 44, and to transmit responses 42 and measurements 44 to the server 18. 
The database 38 is designed to store responses 42 and measurements 44, The database 38 
funher inchjdes a look-up table 46. The table 46 contains a list of patients to be 
monitored, and for each patient, a unique patient identification code and a respective 
15 pointer to one or more script programs 40 assigned to the patient. Each remotely 
programmable apparatus 26 is desi^od to execute assigned script programs 40 received 
iirom the server 18, The Bcript programs 40 may include queries, reminder messages, 
infonnatior)al statements, useful quotations, or other information of benefit to the patient. 
See Appendix A for example script programs. 

FIGURES 3-4 show the structure of a remotely programmable apparatus 26 
according to the preferred embodiment. Referring to KtGURE 3, the apparatus 26 
includes a bousing 62. The housing 62 is sufficiently com]^act to enable the apparatus 26 
to be hand-held and canied by a patient The ^paratus 26 also includes a display 64 for 
displaying queries and prompts to the patient hi the preferred embodiment, the display 
25 64 is a liquid crystal display (LCD), 

The apparatus 26 includes five user input buttons 70A, 70B, 70C, 70D and 70B 
that are located on the same side of the apparams 26 as the display 64. The user inpiit 
buttons 70A-D are for entering in the apparahjs26 responses 42 to the queries and 
prompts. In the prefenred cmbodinQent. the user input buttons 70 A-D are momentary 
contact push buttons. In alternative embodiments, user input buttons 70A-D may be 
replaced by switches, keys, a touch sensitive display screen, or any other data iuput 
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device. 
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The user input button 70E is a emergency or other services button and is 
ptBferably red, but may be of any size, shape, or color that draws special visual or tactile 
attention to the nser. The services provided by the «ser inpnt button 70B are de$cribed in 
more detail below, 

S Three monitoring device jacks 68A, 68B, and 68C are located on a surface of 

housing 62. Ihe device jacks 68A-C are for connecting the apparahis 26 to a number of 
monitoiing devices 28, such as blood glucose meters, respiratory flow meters, or blood 
pressure cuffs Cnol shown in FIGURE 3). The apparatus 26 also inchides a modem jack 
66 for connecting the q,paratUB 26 to a telephone jack through a standaiti connection cord 

1 0 (not shown). The apparatus 26 further includes a visual indicator, such as a light eimtting 
diode (LED) 74. The LED 74 is for visually notf^g the patient that he or she has 
unansweired queries stored in the apparatus 26. 

-no-URE 4 is a schematic block diagram illustrating ihe components of the 
apparatus 26 in greater detail. The apparatus 26 includes a microprocessor 76 and a 

15 memory 80 coimected to the microprocessor 76. The memory 80 is preferably a non- 
volatile memory, such as a serial EEPROM. The memory 80 stores script programs 40 
recdved from the server 18, measurements 44 received fiom the monitoring device 28, 
responses 42 to queries. The microprocessor 76 also inchides built-in read only memory 
(ROM), which stores firmware for controlling the opeacation of the apparatus 26. Thb 

20 firmware includes a script interpreter used by the microprocessor 76 to execute the script 
programs 40. The script interpreter interprets script commandB, which are executed by 
the miwoprocesBor 76. Specific techniques for inteipieting mA executing script 
commands in this mamier are well known in the art. 

The microproccEsor 76 is preferably coimected to manoiy 80 usmg a standard 

25 two-wire interface. The microprocessor 76 is also connected to the user input buttons 70, 
the LBI> 74, a clock 84. and a display driver 82. The clock 84 indicates the cuircnt date 
and time to the microprocessor 76. For clarity of illustration, clock 84 is shown as a 
separate component, but is preferably built into the microprocessor 76. The display 
driver 82 operates under the control of the microprocessor 76 to display infonnation on 

30 the display 64. The microprocessor 76 is preferably a PIC 16C65 oroces-^or Th„ ^n^^r, 
86 is connected to a telephone jack 22 through the modem jack 66. The modem 86 is for 
exchanging data beUveen the server 18 and the processor 76 through the communication 

-8- 
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network 24. The data includes the script programs 40 which are received from the 
server 18 as well as the responses 42 to queries, the device measurements 44, the script 
identification codes, and the patient's unique identification code, which the modem 86 
transmits to the server 18. The modem 86 is preferably a complete 28.8 K modem 
commerciaUy available fi-om Cemietelc. although any suitable modem may be used. The 
processor 76 also includes a component that connects to the telephone jack 22 and a 
microphone 88 and a speaker 89, thereby allowing telephone calls to be processed. 

The device interface 90 is connected to the device jacks 68A, 68B, and 68C. The 
device interface 90 is for interfacing with a number of monitoring devices 28, such as 
blood glucose meters, respiratory flow meters, blood pressure cuffs, weight scales, or 
pulse rate nionitors, through device jacks 68 A-C. • 

The device interface 90 operates mider the control of the microprocessor 76 to 
collect measurements 44 fi-om the monitoring devices 28 and to output the measurements 
to the microprocessor 76 for storage in the memory 80. hi the prefeired embodiment, the 
interface 90 is a standard RS232 interface. For simplicity of illustration, only one device 
interface 90 is shown in FIGURE 4. However, in alternative embodiments, the 
apparatus 26 may include multiple device interfaces to accommodate monitoring devices 
that have diiferent connection standards. 

Referring again to FIGURE 2, the server 18 includes a monitoring application 48. 
The monitoring application 48 is a controlling software application executed by the 
server 18 to perfonn the various functions described below. The application 48 includes 
a script generator 50, a script assignor 52, and a report generator 54. -The script generator 
50 is designed to generate the script programs 40 from script infonnation entered through 
the workstation 20. The script infomiation is entered through a script entry screen 56. In 
the prefeixed embodiment, script entry screen 56 is implemented as a web page on the 
server 18. The workstation 20 includes a web browser for accessing the web page to 
enter the script information. 

FIGURE 5 illustrates the script entry screen 56 as it appears on the workstation 
20. The screen 56 includes a script name field 92 for specifying the name of a script 
program. to be generated. The screen 56 also includes entry fields 94 for entering a set of 
queries to be answered by . a patient. Each entry field 94 has corresponding response 
choice fields 96 for entering response choices for the query. The screen 56 further 

-9- 
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includes check boxes 98 for selecting a desired monitoring device 28, such as a blood 
glucose meter, respiratory flow meter, or blood pressure cuff, from which to collect 
measurements 44. 

The screen 56 additionally includes a connection time field 100 for specifying a 
5 prescribed connection time at which each apparatus 26 executing the script is to establish 
a subsequent communication link to the server 18. The connection time is preferably 
selected to be the time at which communication rates are the lowest, such as 3:00 AM. 
The screen 56 also includes a CREATE SCRIPT button 102 for instructing script 
generator 50 to generate a script program 40 from the infonnation entered in screen 56. 
10 The screen 56 further, includes a CANCEL button 104 for canceling the mfonnation 
entered in screen 56. 

hi the preferred embodiment, each script program 40 created by script 
generator 50 conforms to the standard file format used on UNIX systems. In the standard 
file format, each conunand is listed in the upper case and followed by a colon. Every line 
15 in the script program 40 is terminated by a linefeed character {LF}, and only one 
command is placed on each line. The last character in the script program 40 is a UNIX 
end of file character {EOF}. Table 1 shows an exemplary fisting of script commands 
used in the preferred embodiment of the invention. 

TABLE 1 



SCRIPT COMMANDS — 
Command Description 

25 CLS; {LF} 

Clear the display. 
ZAP: {LF} 

Erase from memory the last set of query responses 
recorded . 
30 LED: b{LF} 

Turn the LED on or off, where b is a binary digit of 0 o 
^x^u.u^w^ ± i_uxijs oji Luiie iijiu, ana an argument of 0 
turns off the LED. 
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WAIT: 
{LF} 



DISPLAY: Display the text following the DISPLAY connnand. 
{chars) {LP} 

INPUT: Record a button press. The m's represent a button mask 
mmTnni{LF) pattern for each of the four input buttons. Each m 
contains an "X" for disallowed buttons or an "O" for 
allowed buttons. For example, INPUT: 0XOX{lf} 
allows the user to press either button #1 or #3 . 
Wait for any one button to be pressed, then continue 
executing the script program. 
COLLECT: Collect measurements from the monitoring device 
device {LF) 

specified in the COLLECT command. The user is 
preferably prompted to connect the specified monitoring 
device to the apparatus and press a button to continue. 
NUMBER: Assign a script identification code to the script program. 
aaaa{LF} The script identification code from the most recently 
executed NUMBER statement is subsequently 
transmitted to the server along with the query responses 
and device measurements. The script identification code 
identifies to the server which script program was most 
recently executed by the remote apparatus. 
Wait until time t specified in the DELAY command, 
usually. the prescribed connection time.. 
CONNECT: Perform a connection routine to establish a 
{LF) communication link to the server, transmit- the patient 

identification code, query responses, device 
measurements, and script identification code to the 
server, and receive and store a new script program; When 
the server instructs the apparatus to disconnect, the 



DELAY: 
t{LF} 



script 



interpreter is restarted, allowing the new script program 
to execute. 



35 



The. script commands illustrated in Table 1 are representative of the preferred 
embodiment and are not intended to limit the scope of the invention. AAer consideration 
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of the ensuing description, it will be apparent to one skilled in the art many other suitable 
scripting languages and sets of script conmiands may be used to implement the invention. 

The script generator 50 preferably stores a script program template which it uses 
to create each script program 40. To generate a script program 40, the script generator 50 

5 inserts into the template the script information entered in the screen 56. For example, 
FIGURES 6A-6B illustrate a sample script program 40 created by the script generator 50 
from the script information shown in FIGURE 5. 

The script program 40 includes display commands to display the queries and 
response choices entered in fields 94 and 96, respectively. The script program 40 also 

10 includes input commands to receive responses 42 to the queries. The script program 40 
farther includes a collect command to collect device measurements 44 from the 
monitoring device 28 specified in the check boxes 98. The script program 40 also 
includes coromands to establish a subsequent communication link to the server 1 8 at the 
connection time specified in field 100 FIGURE 5. The steps included in the script 

1 5 program 40 are also shown in the flow chart of FIGURES 12A-12B and will be discussed 
in the operation section below. 

Referring again to FIGURE 2, the script assignor 52 is used to assign script 
programs 40 to the patients. The script programs 40 are assigned in accordance with 
script assignment information entered through workstation 20. The script assignment 

20 information is entered through a script assignment screen 57, which is preferably 
implemented as a web page on the server 18. 

FIGURE 7 illustrates a sample script assignment screen 57 as it appears on 
workstation 20. The screen 57 includes check boxes 106 for selecting a script program 40 
to be assigned, and check boxes 108 for selecting the patients to whom the script program 

25 is to be "assigned. The screen 57 also includes an ASSIGN SCRIPT button 112 for 
entering the assignments. When button 112 is pressed, the script assignor 52 creates and 
stores for each patient selected in check boxes 108 a respective pointer to the script 
program 40 selected in the check boxes 106. Each pointer is stored in the patient look-up 
table 46 of the database 38. The screen 57 further includes an ADD SCRIPT button 110 

o\} lui uuccssjiiig lue iicnpi cuu^y screen anu a j^nLiiir. o^iviri uuituji i j4 lor ueieiuig a 
script program 40. 

-12- 
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Referring again to FIGURE 2. the report generator 54 is designed to generate a 
patient report 58 from the responses 42 and the device measurements 44 received in the 
serverlS. The patient report 58 is displayed on the workstation 20. FIGURE 10 shows a 
sample patient report 58 produced by the report generator 54 for a selected patient. The 
patient report 58 inchdes a graph 116 of the device measurements 44 received from the 
patient, as well as a listing of the responses 42 received from the patient. Specific 
techniques for wn ting a report generator program to display data in this mamier axe well 
known in the.art. 

The operation of the preferred embodiment is illustrated in FIGURES 1-12. 
FIGURE llA is a flow chart iUusfrating steps inchided in the monitoring application 
executed by the server 18. HGURET IB is a continuation of the flow chart of FIGURE 
MA. h, step 202, the server 18 determines if new script infonnation has been entered 
through the script entry screen 56. If new script information has not been entered, the 
server 18 proceeds to step 206. If new script infomiation has been entered, the serv,ir 18 
15 proceeds to step 204. 

As shown in HGURE 5, the script infonnation includes a set of queries, and for 
each of the queries, corresponding response choices. The script infomation also includes 
a selected monitoring device type from which to collect device measurements 44. Tl,e 
script mfoimation further includes a prescribed connection time for each apparatus to 
establish a subsequent commumcation link to the server 18. The script information is 
generally entered in the server 1 8 by a healthcare provider, such as the patients' physician 
or case manager. Of course, any person desiring to commumcate vyith the patrents may 
also be granted access to the server 1 8 to create and assign script programs 40. Further, it 
is to be ujiderstood that system 16 may include any number of remote interfaces for 
entering script generation and script assignment information in the server 1 8. 

hi step 204, the script generator 50 generates a script program from the 
information entered in the screen 56. The script program is stored in the database 38. 
Steps 202 and 204 are preferably repeated to generate multiple script programs, e.g. a 
script program for diabetes patients, a script program for asthma patients, etc. Each script 
program corresponds to a respective one of the sets of queries entered through the script 
entry screen 56. Following step 204, the server 1 8 proceeds to step 206. 
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In step 206, the server 18 determines if new script assignment infoimation has 
been entered through the assignment screen 57. If new script assignment information has 
not been entered, the server 18 proceeds to step 210. If new script assignment 
information has been entered, the server 18 proceeds to step 208. As shown in FIGURE 
5 7, the script programs are, assigned to each patient by selecting a script program through 
check boxes 106, selecting the patients to whom the selected script program is to be 
assigned through check boxes 108, and pressing the ASSIGN SCRIPT button 1 1 2. When 
button 112 is pressed, the script assignor 52 creates for each patient selected in the check 
boxes 108 a respective pointer to the script program selected in the check boxes 106. In 

10 step 208, each pointer is stored in the look-up table 46 of the database 38. Following step 
208, the server 1 8 proceeds to step 210. 

In step 210^ the server 18 determines if any of the apparatuses are remotely 
connected to the server. Each patient to be monitored is preferably provided with his or 
her own remotely programmable apparatus, which has the patient's unique identification 

15 code, stored therein. Each patient is thus uniquely associated with a respective one of the 
apparatuses. If none of the apparatuses is connected, the server 18 proceeds to step 220. 
If an apparatus is connected, the server 18 receives from the apparatus the patient's unique 
identification code in step 212. In step 214, the server 18 receives from the apparatus 26 
the query responses 42, device measurements 44, and script identification code recorded 

20 during execution of a previously assigned script program. The script identification code 
identifies to the server 18 which script program was executed by the apparatus to record 
the query responses 42 and device measurements 44. The responses, device 
measurements, and script identification code are stored in the database 38. 

In step 216, the server 18 uses the patient identification code to retrieve from the 

25 table 46 the pointer to the script program assigned to the patient. The server 18 then 
retrieves the assigned script program from the database 38. In step 218, the server 18 
transmits the assigned script program to the patienfs remotely programmable apparatus 
through the communication network 24. Following step 218, the server 18 proceeds to 
step 220. 

on^p .t.^v, iiis^ vcj io uciciijjiiicb 11 ci paiiciii icpuil requesi nas oeen receivea 
from the workstation 20. If no report request has been received, the server 18 retitnis to 
step 202. If a report request has been received for a selected patient, the server 1 8 
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retrieves &om fie database 38 the measurements 44 and quay ifiBponBes 42 last received 
itora the patient, step 222. In stop 224, the server 18 generates and display the patient 
report 58 on the workstation 20. As sho^ra in FIGURE 10. the report 58 includes the 
device measurements 44 and query responses 42 last received from the patient. 
Following stqi 224, the server 18 returns to Btep 202. 

FIGimES 12A-12B illustrate the steps included in the script prograrx, executed by 
the apparatus 26. Before the script program is received, the apparatus 26 is initially 
progrmnmed with the patient's unique identification code attd the script intetpr^ter used 
by microprocessor 76 to execute the script program. The initial prograjnnring may be 
achieved during mannfacture or during m initial connection to the server 18. FoHowing 
initial programming, the apparatus 26 receives from the server 18 the script program 
assigned to the patient associated with the apparatus 26. The script program is received 
by the modem 86 through a first communicaUon link and stored in the memory 80. 

In step 302. microprocessor 76 assigns a script identification code to the script 
program and storea the script identification code in the memory 80. The script 
identification code is subsequently transmitted to the server 18 along with the query 
responses 42 and the device measurements 44 to identify to the server 18 which script 
program ivas most recently executed by apparatus 26. In step 304, the microprocessor 76 
lights LED 74 to notify the patient that he or she has unanswered queries stored in the 
apparatus 26. The LED 74 preferably remains lit until the patient answers Ore queries. In 
step 306. the microprocessor 76 erases from the memory 80 the last set of quary 
responses recorded. 

In step 308, the microprocessor 76 prompts the patienfby displaying on the 
display 64 "ANSWER QUERIES NOW? PRESS ANY BUTTON TO START", hi step 
310, the microprocessor 76 waits until a reply to the prompt is received from the patient! 
When a reply is received, the microprocessor 76 proceeds to step 312. hi stop 312, the 
microprocessor 76 executes successive display and input commands to display the queries 
and response choices on the display 64 and to receive responses to the queries. 

FIGURE 8 illustrates a sample query and its corresponding response choices as 
they appear on the display 64 The response choices are positioned on the display 64 stich 
that . each response choice is located proximate a respective one of input buttons 70A-D. 
In the preferred embodiment, each response choice is displayed immediately above a 
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respective input button 70A-D. The patient presses the button 70A-D corresponding to 
his or her response. The microprocessor 76 stores each response in the memory 80. 

In steps 314-318, the microprocessor 76 executes conmiands to colJect the device 
measurements 44 jfrom a selected the monitoring device 28.. The script program specifies 
5 the selected monitoring device from which to collect the measurements. In step 314, the 
microprocessor 76 prompts the patient to connect the selected monitoring device 28, for 
example a blood glucose meter, to one of device jacks 68 A-C, A sample prompt is shown 
m FIGURE 9. In step 316, the microprocessor 76 waits until a reply to the prompt is 
received from the patient, men a reply is received, the micrcprocessor 76 proceeds to 
10 step 318. In step 318, the microprocessor 76 collects device measurements 44 from the 
monitoring device 28 through the interface 90. The measurements 44 are stored in the 
memory 80. 

In step 320, the microprocessor 76 prompts the patient to connect the apparatus 26 
to the telephone jack 22 so that the apparatus 26 may connect to the server 18 at the 
prescribed connection time. M step 322, the microprocessor 76 waits imtil a reply to the 
prompt is received from the patient. When a reply is received, the microprocessor 76 
turns off the LED 74 in step 324. In step 326, the microprocessor 76 waits until it is time 
to connect to the server 1 8. The microprocessor 76 compares the connection time 
specified in the script program to the ciurent time output by the clock 84. 

In step 328, the microprocessor 76 establishes a subsequent commimication link 
between the apparatus 26 and the server 18 through the modem 86 and the 
communication network 24. If the connection fails for any reason, the microprocessor 76 
repeats step 328 to get a successful connection. Li step 330, the microprocessor 76 
transmits the device measurements 44, query responses 42, script identification code, and 
25 patient idenfificafion code stored in the memory 80 to the server 18 through the 
subsequent communication link, hi step 332, the microprocessor 76 receives through the 
communication network 24 a new script program from the server 18. The new script 
program is stored in the memory 80 for subsequent execution by the microprocessor 76. 
Following step 332, the script program ends. 

iiiv.iiiiwiui5 bj^Mciii ui luc preseni invention is tJiat it allows 

each patient to select a convenient time to respond to the queries, so that the monitoring 
system is not intrusive to the patient's schedule. A second advantage of the monitoring 
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system is that it incurs vefy low coinmm)icatiDiis charges because each remoto jipparatuR 
connects to the server 18 at toes when oommunicaiion rates are lowest Moreover, the 
cost to ma^iufaDture each remote tho apparatus 26 is voiy low cotnpared to personal 
computers or internet tenninals, so that the monitoring Bystcm is highly affordable^ 
5 A third advantage of the monitorinfi system is tb^t it allows each a^rparatus 26 to 

be programmed remotely Through script programs 40, Patient surveys, connection times, 
display prompts, selected raonitoiing devices, patient customization, and other 
operaUonal details of each appatatuB 26 may be easily changed by transmitting a new 
script program 40 to apparatus 26, Moreover, each script program 40 may be easily 
1 0 created and assigned by remotely accessmg the server 1 8 through the Intemet. Thus, the 
invention provides a powerful, convenient, and inexpensive system for remotely 
moniloiing a large number of patientfl. 

FIGURES 13-15 illustrate a second embodiment of the invention in which each 
remotely programmable apparahis includes all of the functionality of the first 
15 embodiment described above while also including speech lecogniHon and speech 
synthesis ftinctionality. FIGURE 13 shows a perspective view of the remotely 
progranmiable apparatus 27 according to the second embodiment. The apparatus 27 
incjudcs a speaker 72 for audibly comraumcating queries and prompts to the patient. The 
apparatus 27 also includes a microphone 118 for receiving spoken responses to the 
queries and prompts. The apparatus 27 may optionally include a display 64 for 
displaying pmmpts to the patient, as shown in FIGURE 14. 

FIGURE 15 is s schematic block diagram illustrating the components of the 
apparatus 27 in greater detail. The apparattis 27 is shnilar m desj^ to the apparatus 26 of 
the preferred embodiment except that tho apparahis 27 includes an audio processor chip 
120 in place of the microprocessor 76. The audio processor chip 120 is preferably an 
RSC-164 chip commercially avajlabb from Sensory Circuits Inc» of 1735 N. First Street, 
San Jose, Calif. 95112. 

The audio processor chip 120 has a microcontroller 122 for executing script 
programs received firom the seiver 18. A memoiy 80 is connected to the microcontroller 
30 122. Memory 80 stores the script programs and a script interpreter used by the 
raicrocoritroller 122 to execme the Bcript programs. The memory 80 also stores 
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measurements received from the monitoimg device 28, responses to the queries, script 
identification codes, and the patient's unique identification code. 

The audio processor chip 120 also has built in speech synthesis functionality for 
synthesizing queries and prompts to a patient through the speaker 72. For speech 
synthesis, the chip 120 mcludes a digital to analog converter (DAC) 142 and an amplifier 
144. The DAC 142 and the amplifier 144 drive the speaker 72 under the control of the 
microcontroller 122. 

The audio processor chip 120 further has built in speech recognition functionality 
for recognizing responses spoken into the microphone 118. Audio signals received 
- through the microphone 118 are converted to electrical signals and sent to a preamp and 
gain control circuit 128. The preamp and gain control circmt 128 is controlled by an 
automatic gain control circuit 136, which is in turn controlled by the microcontroller 122. 
Afler being amplified by the preamp 128, the electrical signals enter the chip 120 and 
pass through a multiplexer 130 and an analog to digital converter (ADC) 132. The 
resxilting digital signals pass through a digital logic circuit 134 and enter microcontroller 
122 for speech recognition. 

The audio processor chip 120 also includes a RAM 138 for short-tenn memory 
storage and a ROM 140, which stores programs executed by the microcontroller 122 to 
perform speech recognition and speech synthesis. The chip 120 operates at a clock speed 
detemiined by a crystal 126. The chip 120 also includes a clock 84 that provides the 
current date and time to the microcontroller 122. As in the preferred embodiment, the 
apparatus 27 includes an LED 74, display driver 82, modem 86, and"device interface 90, 
all of which are connected to the microcbnfroller 122. 

The operation of the second embodiment is similar to the operation of the 
prefen-ed embodiment except that queries, response choices, and prompts are audibly 
communicated to the patient through the speaker 72 rather than being displayed to the 
patient on the display 64. The operation of the second embodiment also differs from the 
operation of the preferred erabodiment in that responses to the queries and prompts are 
received through the microphone 1 1 8 rather than through user input buttons. 

y,x uic i.ei;ona emoooiniem are. similar to the script program 

shown in FIGURES 6A-6B, except that each display command is replaced by a speech 
synthesis command and each mpul command ,s replaced by a speech recogmtion 
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command. The speech synthwis ooromands are executed by the microcontioUer 122 to. 
synthesize the queries, response choices, and prompts through speaker 72. Th^ speech 
recognition commands are exeovted by the micrDcontroller 122 to recognize xespoiiBes 
ppoken into microphone 1 18. 

For example, to ask the patient how he or she feels and record a re^onse, the 
microcoBtrpller 122 lirst executes a speech synthesis command to synthesize through the 
speaker 72 "How do you feel? Please answer with one of the following responses: veiy 
bad. bad, good, or very good." Next, the microcontroller 122 executes a speech 
recogmlion command to recognize the response spoken into the micjophone 118. The 
recognized response is stored in the memory 80 and subsequently transmitted to the 
sender. Other than the ditferences described, the operation and advantages of the second 
embodiment are the same aa the operation and advantages of the preferred erobodunent 
described above. . . 

Although the first and second embodiments focus on querying individuals and 
collecting responses to the queries, the system of the mvention is not limited to querying 
applications. The system may also be used simply to communicate messages lo the 
individuals. HGURES 1 6-19 illustrate a.third embodiment in which the system is used to 
perfonn diis automated messaging function. In the thi«l embodiment, each script 
program contains a set of statements to be communicated to an individual rather than a set 
of queries to be answered by the individual. Of course, it will be apparent to one skUled 
in the art that the script programs may optionally mclude both queries and statements. 

The third cmbodnnent also shows how the quwies and statements may bo 
customized to each individual by merging personal data with Ihe Tciipt programs, much 
like a standard mail merge apphcation. As mentioned above, the individual may be 
identified for selection of mdividualized information either through an individual 
identification code associated with the remote apparatus 26 and stored in memory 80. 
Refeiring to ncURE 16. personal data relating to each individual is preferably stored in 
the look-up table 46 of the database 38. By way of example, the data may include each 
individual's name, the name of each individual's physician, test results, appointmenl dates, 
or any other desired data. As in the preferred embodiment, the database 38 also stores 
generic script programs 40 created by the script generator 50. 
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The server 18 includes a data merge program 55 for merging the data stored in 
table 46 with generic script programs 40. The data merge program 55 is designed to 
retrieve selected data from table 46 and to insert the data into statements in generic script 
programs 40, thus creating custom script programs 41. Each custom script program 41 
5 contains statements that are customized to an individual. For example, the statements 
may be customized with the individuars name, test results, etc. Examples of such 
customized statements are shown in FIGURES 17-18. 

The operation of the third embodiment is similar to the operation of the preferred 
embodiment except that the script programs are used to communicate messages to the 

10 individuals rather than to query the individuals. Each message is preferably a set of 
statements.. Referring to FIGURE 19, the statements may be entered in the server 18 
through the script entry screen 56, just like the queries of the preferred embodiment. 

Each statement preferably includes one or more insert commands specifying data 
from table 46 to be inserted into the statement. The insert commands instruct the data 

15 merge program 55 to retrieve the specified data from the database 38 and to insert the 
data into the statement. For example, the insert commands shown in FIGURE 1 9 instruct 
the data merge program 55 to insert a physician name, an appointment date, a patient 
name, and a test result into the statements. As in the preferred embodiment, each 
statement may also include one or more response choices, which are entered in fields 96. 

20 Following entry of the statements and response choices, CREATE SCRIPT button 

102 is pressed. When the button 102 is pressed, the script generator 50 generates a 
generic script program from the information entered in the screen 56. The generic script 
program is similar to the script program shown in FIGURES 6A-6B, except that the 
display commands specify statements to be displayed rather than queries. Further, the 

25 statements include insert commands specifying data to be inserted into the script program. 
As in the preferred embodiment, multiple script programs are preferably generated, e.g. a 
generic script program for diabetes patients, a generic script program for asthma patients, 
etc. The generic script programs are stored in the database 38. 

Following generation of the generic script programs, the server 1 8 receives script 

FIGURE 7, the script programs are assigned by first selecting one of the generic script 
programs through the check boxes 106, selecting individuals through the check boxes 
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108, and pressing the ASSIGN SCRIPT button 112. When the button 112 is pressed, the 
data merge program 55 creates a custom script progrEon 41 for each individual selected in 
checkboxes 108. 

Each custom script program 41 is preferably created by using the selected generic 
script program as a template. For each individual selected, the data merge program 55 
retrieves from the database 38 the data specified in the insert commands. Next, the data 
merge program 55 inserts the data into the appropriate statements in the generic script 
program 40 to create a custom script program 41 for the individual. Each custom script 
program 41 is stored in the database 38. 

As each custom script, program 41 is generated for an individual, the script 
assignor 52 assigns the script program 41 to the individual. This is preferably 
accomplished by creating a pointer to the custom script program and storing the pointer 
with the individual's unique identification code in the table 46. When the individual's 
remotely programmable apparatus connects to the server 18, the server 18 receives from 
the remotely programmable apparatus 26 the individual's unique identification code. The 
server 18 uses the umque identification code to retrieve from the table 46 the pointer to 
the custom script program assigned to the individual. Next, the server 18 retrieves the 
assigned script program from the database 38 and transmits the script program to the 
individual's remotely programmable apparatus 26 through the communication network 



The apparatus receives and executes the script program. The execution of the 
script program is similar to the execution described in the preferred embodiment, except 
that statements are displayed to the individual rather than queries. FIGURES 17-18 
illusfrate two sample statements as they appear on the display 64. Each statement 
mcludes a response choice, preferably an aclcnowJedgment such as "OK". After reading a 
statement, the individual presses the button 70A-D corresponding to the response choice 
to proceed to the next statement. Altemalively, the script program may specify a period 
of time that each statement is to be displayed before proceeding to the next statement. 
The remaining operation of the third embodiment is analogous to the operation of the 
preferred embodiment described above. 

Although it is presently preferred to generate a custom script program 4 1 for each 
individual as soon as script assignment information is received for the individual, it is 
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also possible to wait until the individual's apparatus 26 connects to tbe server IS beforo 
generating the custom script pjtjgram 4L This is accomplished by creating and storing a 
pointer to the genmo script program 40 assigned to the mdividual, as previously 
described in the preferred embodiment When the mdividuaJ'a apparatus 26 connects to 
the Eerver 18, the data merge program 55 creates a oistom script program 41 for the 
mdividual from the generic script program 40 assigned to the individual. The custom 
script program 4 ns then sent to the individual's appaiatus 26 for execution. 
Alternate Embodiments 

Jii an alternate embodiment, when the user or patient (the tenns user and patient 
are used interactively) activates the user input button 70E (hereinafter the red button) a 
command signal is sent to the processor 76. The processor 76 dial a preset phone number 
according to the command signal. The preset phone number is "that of m answering 
service at the server 18 or at a workstation 20. The answering service identifies the 
patient or user associated with the remote apparatus 26 that generated the call based on an 
15 identifier sent with the call and user infoimation stored in memory in the database 
(similar to caller ID). The system (server 1 S or workstation 20) that receives the call then 
retrieves patient information vrith previous patient/User responses stored at the server's 
database 38, within memory at the workstation 20, or at some other remotely located 
storage site. The retrieved patient information is displayed to a Kve person who is in 
telephonic communication with the patient. This allows the patient to be placed in 
immediate contact with a person who has displayed before them the patient's personal 
health information or other patient historical information. The person receiving the call 
provides effectiYe communication with the patient, because of the ability to view 
pertinent information. 

^ ^ alternate embodiment, an automated answering service is the recipient of the 
call made by the remote apparatus 26. The automated answering service asks a series of 
questions according to the retrieved patient mformatiou in order to triage the patient 
toward different actions depending upon tlie situation. The patient information also 
inchJdes previous patient interactions with the automated answering service. 

The system receiving the call process patient responses according to the content 
associated with the question asked. Content is one of the following categories: 
syniptoms; behavior; knowledge. The categories include such thmgs as requests for 



20 



30 



wo 02/2J317 



PCT/US0J/2811J 



service or product orders. In one example, the automated answering service asks "66 you 
have difficulty breathing? press the red button if you are." If the patient then presses the 
red button, the call is forwarded to a case manager or a nurse on call. 

In another example, red button selection is associated with a request for service. 
When the red button is pressed, the automated answering service asks "do you need 
someone to change yoiff bed? press the red button if yes." If the patient presses the red 
button, a home care agency coordinating ancillary daily activity services is notified or is 
forwarded the caD. Other service companies, such as transport companies or concierge 
service companies, are other possible recipients of forwarded calls depending what 
actions are available to the patients. 

The automated answering service is dynamically adaptable based on previous 
interactions with the automated answering service: For example, the past couple of times 
the patient activated the red button and answered the queslion(s), the patient was 
connected to an emergency health care worker. If the worker determined through review 
questions of the patient's present condition, maybe information generated by the 
monitoring device sent over the network 24 to a workstation operated by the worker, and 
retrieved patient infomiation that no emergency existed, the worker records this situation 
into the patient's records. If the patient's record includes a number of false alarms that 
exceed a predetennined limit over a period of time, the automated answering service 
reprograms itself so that tiie next time the patient activates the red button the patient is 
directly connected to a live person that is designated for non-emergency patient 
interaction or. to other, questions that direct the patient to th? person designated for 
non-emergency patient interaction. This frees-up emergency healthcare workers fi-om 
dealing with someone who has a history of not needing their, expertise. 

FIGURES 20 and 21 illustrate alternate embodiments of the invention illustrated 
in FIGURE 1. h, FIGURE 20, the remote apparatus 26 is a personal computer including 
a processor, and a user interface, e.g. display, keyboard, mouse, or other input and output 
devices (not all shown), that receives the script program, processes the script program and 
presents the script program for user interaction. For example, the script program requires 
that the personal computer present an image of a stand-alone remote apparatus 350, such 
as the Health Buddy™ produced by Health Hero Net^vork, h:c., on the display The user 
then interacts wth the displayed image of the stand-alone remote apparatus by operating 
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the user interface{s) of the personal computer to select displayed responses. The 
displayed image of the stand-alone remote apparahis presents a virtual image with the 
same fiinctionality as the apparatuses 26 and 27, as described above in FIGURES 3 and 
13. It can be appreciated to those of ordinary skill in the art that the system of 
5 PIGURE 20 provides all or part of the functionality of the apparatuses shoAvn in 
FIGURES 3 and 13, but does it on a personal computer. 

FIGURE 21 includes all the components of the FIGURE l and a digital television 
network 36 in communication with the server 18 and the remote apparahis 26. The 
remote apparatus 26 of FIGURE 21 is an interactive television system that includes a 
10 processing unit 33, such as a satellite broadcast receiving, set-top processor with OpenTV 
signal processing software, a display 34, such as a television set, and a user interface 35, 
such as a remote control. The remote apparatus 26, through the processing unit 33, is 
coupled to the communication network 24, the digital television network 36 and the 
monitoring device 28. 

1 5 The processing unit 33 includes a CPU, memory and embedded software for 

receiving and processing both digital entertainment and advertisement content and digital 
script programs. Also, the processing unit 33 allows the user to view the entertainment 
and advertisement content, such as television programming, and interact with (i.e. 
respond to) the script programs. The script program(s) sent from the server 18 are 
20 viewable on the display 34 as they would appear on the display 64 of apparatus 26 or are 
viewed on a portion of the display 34. For example, the question with options shown in 
FIGURE 8 would appear on the display 34. The user makes a selection of one of the 
choices by using the user interface 35, i.e. givmg voice commands that are processed by a 
voice reception system, controlling and activating a cursor, etc. Example methods of 
25 maldng a selection are to control a cursor icon on the display screen of the display 34 and 
activate the cursor icon when it is co-located with one of the choices, to assign different 
keyboard keys are designated as a different one of the displayed choices. Another 
method is to have the user interface include voice actuation software for processing user 
voice commands that request selection of a desired choice. 

- With respect to this invention, a "broadcast" includes any form of delivering the 
content fi-om a source to many viewers, including transmission over the an^vaves or via 
cable, the hitemet, a closed-circuit network, or other means of communication. A 
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'broadcast" does not require multiple persons to watch at once, but rather can include 
multiple individual and independent viewings, such as in the form of video on demand or 
access to web pages. Moreover, the term "broadcasf ' may inchide a single tailored 
transmission from a source to a single intended viewer. Accordingly, while a "broadcast" 
5 may include a transmission from one point to multiple recipients, it is not limited to that 
case. Likewise, with respect to this invention, a "broadcast" is "transmitted" in any of the 
above forms. . 

The processing unit 33 is a multimedia processor that receives transmitted 
broadcast programs from a digital broadcast network 36 via a communication link, such 
10 as a satelhte or cable link. The processing unit 33 also transmits as well as receives data 
via the commimication network 24. In addition, the multimedia processor has expansion 
ports to support additional user interface and other devices, such as keyboards, joysticks, 
trackballs^ and to accept add-on circuits for enhanced soimd, video, or processing 
perfomiance. 

^5 FIGURE 22 is an example for illustrative purposes only of a method for 

increasing user use of script programs by allowing the user to quickly access the script 
program during viewing of an entertainment or advertisement program in an interactive 
TV system. FIGURE 22 illustrates a process performed by the system shown in 
FIGURE 21. At block 400, the server 18 generates an interactive script program. In an 

20 alternate embodiment, the script program is fully or partially created at another remotely 
coupled computer, such as workstation 20, and added to naultimedia content, then the 
script program and multimedia content is sent to the server 1 8. InjDne embodiment, the 
script program is specialized for a specific user according to a health care professional 
request or to a predefined health regimen based on user profile information. In an 

25 alternate embodiment the script program is generated in relation to entertainment or 
advertisement content that it will later be broadcasted with. Next, at block 402, the 
generated script program is combined Avith digital produced entertainment or 
advertisement content, i.e. a multimedia presentation, to create digital broadcast 
programming. The digital broadcast programming is then broadcasted or transmitted over 

30 the chosen communication hnk, block 406. At block 408, the processing unit 33 receives 
and processes the digital broadcast programming then presents (he entertaimnent or 
advertisement content and the script program. The processing unit 33 as directed by 
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software instructions previously imbedded in the processing unit 33, included with the 
digital broadcast programming or a combination of both processes the digital broadcast 
programming by determimng its content and how that content is to be presented on the 
display 34. For example, the processing miit 33 detennines if the script progi^ is to be 
5 referenced by an icon over the entertainment content or displayed on a portion of the 
display with the entertaimnent content. As part of the presentation from block 408 the 
user is informed of any script program included in the broadcast programming, block 410. 
Then, at block 426, the user is presented with the script program after the user selects or 
activates the indication, e.g. an icon. Lastly, at block 428, the user interacts with the 
1 0 script program by responding to any queries and inputting any requested measurements or 
other responses. The interaction with the script program is similar to that described above 
for the system of FIGURE 1. In another embodiment, the script program is presented in 
conjunction with the entertainmenl or advertisement content without requiring the user to 
select or activate an indicator. 

15 HGURES 23 and 24 are example images presented on the displays 34 in the 

system illustrated in FIGURE 22. FIGURE 23 illustrates a screen shot of a broadcast 
program 250 that includes entertainment content 252. such as a video program on heart 
surgery, and an icon 254. The icon 254 indicates that a script program is available for the 
viewer. In order for the viewer to access the script program, the viewer selects the 
20 icon 254. The program broadcasted from the broadcast network 24 may have included an 
entire script program or jnst a portion of a script program. If the entire script program 
were included with the broadcast, selection of the icon 254 would beiin execution of the 
script program that was received. However, if only a portion of the script program was • 
received and, for example, that portion only required that the icon 254 be displayed with 
25 the entertainment content 252. selection of the icon 254 sends a signal through a back 
chamiel, i.e. the link to the communication network 24, to the server 18. The sent signal 
is a request for the rest of or just more of ihe script program to be sent to the apparatus 26 
either through broadcast nehvork 36 or communication network 24. 

FIGURE 23 illustrates a screen shot of a broadcast program 250 that includes 

30 

' " " "-"^ secnon mat presents a script program image 256. In this- 

example the viewer can mteract wilh the script program image 256 wh.le simultaneously 
viewing the enferta.runent content 252. As in FIGURE 22 above, the scnpt program may 

-26- 
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be fiilly or partially received and processed by the processing unit 33. And again, if it has 
only been partially received, viewer interaction at a predetermined spot in the displayed 
interaction process automatically initiates a request through the back channel to the 
server 1 8 for the rest of the script program. 

Because the broadcast program 250 is a digital broadcast, it can be readily 
appreciated by those of ordinary skill in the art of digital interactive television, that the 

entertainment content may be paused until viewer completion ofthe script program. The 
script program which can be sent with an initial broadcast program or during presentation 
of a previously delivered broadcast program that is being presented on the display may 
also include instructions to pause the entertainment content until viewer completion ofthe 
script program at which time the entertainment program resumes. For example, the 
viewer's/patient's doctor creates a message at the workstation 20 requesting that the 
patient as soon as possible send blood pressure measurement readings. This message is 
generated as a new script program at the server 18. The server 18 then sends the new 
script program to the broadcast network 36. The broadcast network 36 includes hardware 
and/or software mechanisms for saving the new script program for inclusion with the next 
patient requested entertainment or advertisement content to be sent to the patient in the 
case where the patient is not presently viewing a broadcast from the broadcast network 36 
or for just broadcasting the script program alone. If the patient is presently viewing 
entertainment or advertisement content received from the broadcast network 36, the new 
script program is received, processed and presented to the patient by the apparatus 26. 
The received new script program may include instructions to pausejhe presently viewed 
entertainment or advertisement content. 

If the script program is specified for a particular patient, the server 1 8 or broadcast 
network 36 encodes the smpt program for that patient. The apparatus of that patient 
includes a decoding component within the processing unit 33 for decoding the encoded 
script program received with the broadcast program. For example, the script program 
includes a weight history chart of the patient. The present invention wants only the 
patient coiresponding to this weight history chart to have viewing access. Therefore, it is 
encoded for transmission and encoded only by the corresponding patient's apparatus 26. 
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It can be appreciated to one of ordinary skill in the art that this decision, as with 
the other flow diagram decisions, can be an inherent decision in the processing of the 
received entertainment/advertisement progranruning and script program. 

The embodmients of FIGURES 20 and 21 may also be implemented without any 
5 entertainment or advertisement content and perform the ilmctions as to those that 
illustrated and described for FIGURE 1 . 

The script programs or entertainment/advertisement programming can be designed 
for education and training of users. For example, the script program or information 
content could show a user, such as a pati^t, how to effectively use a medical treatment 
10 device. Also, the script program or information content could describe to users, such as 
doctors, nurses or anyone other professional, different treatment styles, plans or new 
medication. ^ 

A wide variety of information may be collected, delivered and analyzed in 
accordance with the present invention. For example, abandoned U.S. Patent Application 
15 No. 09/378,188 which is a continuation of US. Patent No. 5,985,559, and imassigned 
U.S. Patent Application attorney docket No. HERO-M089 which is a continuation of 
U.S. Patent Application No. 09/041,809 (the text of which are hereby incorporated by 
reference) discusses infonnation related to disease causes, treatments, and cures. Script 
programs include a set of queries for requesting data on lifestyle, environment, behavior, 

20 dmg compliance, drug response over time, and other aspects. This data is then analyzed 
to identiiy trends and . establish subgroups with similar responses. 

Individuals' behavioral and environmental information in conjunction with their 
gene sequence infonnation is analyzed to find drug candidates and drug targets. 
Individuals previously designated as having a high risk for developing a particular disease 

25 are each given an apparatus 26. Queries related to the individuals' behavior and 
environment are included in a script program sent from a server 1 8 to the apparatus 26 or 
from a server 18 to the apparatus 26 through a broadcast network 36. The individuals' 
responses are sent back to the server 18. The process of collecting individuals' 
information can take place over a long period of time to ensure accurate data and to allow 

30 researchers to observe progression of ihe disease. A data mining program on the server 
analyzes the individuals' behavroral and environmental informatron. as well as their ^ene 
sequence information. Differences in gene sequence information, or in behavioral and 
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environmental factors between individuals who show a severe disease phenotype and 
those who show a mild severe disease phenotype can then be distinguished and used to 
develop new drug candidates, targets, or general treatments. 

Genetic testing allows an individual to determine whether or riot he or she has a 
predisposition to a certain disease. The degree of expressivity of a certain disease will be 
detemiried in part by an individual's environment and hfestyle. The environment and 
lifestyle information is retrieved, from responses to queries sent from the server 18 to the 
apparatus 26 or from the server 18 to the apparatus 26 through the broadcast network 36. 
The present invention interprets a patient's gene sequence information and his or her 
environment and hfestyle to come up with a personalized prognosis. This procedure can 
be repeated many times over the course of a . disease state to monitor a patient's condition, 
hi addition, disease-causing pathogens can also have their genes sequenced. Using these 
sequences in combination with information about a patient's environment and lifestyle, 
the present invention comes up with a personalized treatment plan, ideaUy to eliminate 
the pathogen. It is also possible to use the procedure described above to monitor the 
course of the disease-state produced by a pathogen. Finally, a genotype-to-phenotype 
map or database c;m be constructed for developing better treatments and aiding in 
research. 

Although the above description contains many speciJScities, these should not be 
construed as limitations oh the scope of the invention but merely as illustrations of some 
of the presently preferred embodiments. Many other embodiments of the invention are 
possible- For example, the scripting language and script commands shown are 
representative of the preferred embodiment. It will be apparent to one skilled in the art 
many other scripting languages and specific script commands may be used to implement 
the invention. 

Moreover, the invention is not limited to the specific applications described. The 
system and method of the invention have many other applications both inside and outside 
the healthcare industry. For example, pharmaceutical manufacturers may apply the 
system in the clinical development and post marketing surveillance of new drugs,- using 
the system as an interactive, on-line monitoring tool for collecting data on the efficacy, 
side effects, and quality of life impact of the drugs. Compared to the current use of labor- 
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15 



20 



25 



intensive patient interviews, the system provides a fast, flexibly and cost effective 
alternative for monitoring the use and effects of the drugs. 

The system may also be used by home healthcare companies to enhance the 
service levels provided to customers, e.g. panic systems, sleep surveillance, specific 
monitoring of disease conditions, etc. Alternatively, the system may be used to monitor 
and optimize the inventory of home-stationed health supplies. As an example, the system 
may be connected to an appropriate measuring device to optimize timing of oxygen tank 
delivery to patients with chronic obstructive pubnonary disease (COPD). 

The system and method of the invention also have many applications outside the 
healthcare industry. For example, the system may be used for remote education over the 
Intemet, facilitating educational communication with children or adult trainees who lack 
access to sophisticated and expensive computer eqmpment. The system may also be used 
by law enforcement officers to perform on-line surveillance of individuals on probation or 
parole. 

In an alternate embodiment, the software and hardware components of any one of 
the remote apparahises 26 or 27 are incorporated directly into a monitoring device. This 
allows a patient to only have to interact with one device for their entire health monitoring 



needs. 



Further, the invention has numerous applications for gathering data from remotely 
located devices. For example, the system may be used to collect data txom smart 
appliances, such as identification check systems. Examples of appliances that are used as 
smart appliances are refi:igerator, telephone, stove, clock radio, VCR, or any other 
electrical or non-electrical device including the monitoring device 28. The smart 
appliance includes some or all of the components of the remote apparatuses 26 or 27 as 
illustrated in FIGURES 4 and 15. The smart appliance with the necessary hardware or 
sottwaie components provides all the interactive capabilities described and shown for 
remote apparatuses 26 or 27, see FIGURES 8-12, 14, 17 and 18. In one embodiment, the 
assigned scripts are in the fomi of a recorded voice that is sent over the communication 
network (e.g. voice over IP) to the appliance or remote apparatus. Also, the user responds 
30 to the voice. scripts through activation of buttons according to instructions in the voice 
• scripts or by verbally responding to the voice scripts. The verbal responses by the user 
are sent to the sender or workstation over the communication nehvork (e.g. voice over IP). 



- 30- 



0 



wo 02/21317 



PCT/US01/281J1 



The server or workstation includes a voice rccogninon component for inteipreting the 
user's verbal respoBBes, records the response and detennines the next question dr request 
(verbal or otherwise) to be- sent to the user according to the responses. Live voice 
coftimunication is also possible between the remote apparatus and the server or 
workstation over the comnuinioafioa network. 

Also, the monitomg device inoludes a coirininnioation component for allowing 
the monitoring devic© to send data directly to the server IB. The server 1 8 then sends the 
monitoring device data to the patient's smart appliance for display to the patient. In an 
qJtemate additional setup, the monitoring device sends the data to the smart apparatus. 

Alternatively, the system may bo applied to the remote monitoring of facilities, 
including safety and security monitoring, or to environmental monitoring, including 
pollution control and pipeline monitoring* Many other suitable applications of the 
invention will be apparent to one skilled ih the art. 

Therefore, the scope of the invention should be detetmined not by the examples 
given, but by the appended claims and their legal equivalents. 
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CLAIMS 



1. Asysteroforretootelymonitomisanindividual^theaystemw^^ 
a xexx,ote apparatus for interacting ^vith the individual, the remote apparatus being 
5 in conmnmication with a sorer ^tem via a commuiiicBlion network; 
the server sysiem comprising; 

a script generator for gene:ratine a script progmn from a set of queries and 
the script program to the remote apparatus, the script program being executable 
by the r^ote appals to communicate the set of queric to the individual to receive 
1 0 responses to U>e sat of ,neries. and to tran^t the responses fiom the ™ apparatus to 
the server over the conimumcation network: 

a database accessible by the script generator for storing the script program,, 
the queries, theresponscs to the set of queries, and individual profile^ and 

an answering service; and 
' ^ wherein the remote apparatus comprises: 

a communication component for receivmg the script program ftom the 
server and for transmitting the responses to the server; 

a user interfice comprising a microphone, speaker and a voice 
communication button; and 

20 

a processor connected to the communication component and the user 
mterface for executing the script program to communicate the set of queries to the 
individual, to receive the responses to the set of queries from the user interface, and to 
transmit the responses to the server, 

wherein when the voice communication button is activated, the answering service 
25 sends a series of questions as voice communication from a ator.d set of questicms to the 
— - ^,^auai ,o respond to. stores responses to each provided 
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question in the series of questions and provides a service based on the individual's 
response to the questions. . 

2. The system of Claim 1, wherein the provided service is communication 
with a health care professional. 

3. The system of Claim 1, wherein the provided service is communication 
with a service provider. 

4. The system of Claim 1, wherein the answering service includes a speech 
recognition component for receiving spoken responses to the series of questions. 

5. The system of Claim 1, wherein the answering service includes a speech 
synthesis component for making the set of queries into a series of questions. 

6. A method for remotely monitoring an individual at a server system in 
commmucation with an apparatus of the individuals over a communication network, the 
metliod comprising: 

generating at the server system a script program from a set of queries at the sender 
system and sending the generated script program jSrom the server system to the apparatus, 
wherein the script program is executable by the apparatus to communicate the set of 
queries to the individual, to receive responses to the set of queries, and to transmit the 
responses from the apparatus to the server over the communication network; and 

storing the script program, the queries, responses to the set of , queries and 
individual profiles in a database at the server system; 

activating a voice communication button at a user interface of the apparatus; 

sending a series of questions as voice cormnxmication from the stored set of 
queries to the apparatus from an answering service for the individual to respond to, 
according to activation ofthe voice communication button , 
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receiving and storing at the answering service responses to the sent series of 
questions; and 

providing a service based on the responses to the questions. 

7. The method of Claim 6, wherein the provided service is communication 
with a health care professional. 

8. The method of Claim 6, wherein the provided service is communication 
with a service provider. 

9. An apparatus, said apparatus comprising: 

a user interface component for interacting with an individual, said user interface 
component comprising: 

a communication component for receiving a script program from a server 
and for transmitting responses to the script program to the server over a commimications 
network, the script program comprises a set of queries; 

a user interface; and 

a processor connected to the communication component and the user 
mterface for executing the script program to communicate the set of queries to the 
individual to receive the responses to the set of queries from the liSer interface and to 
transmit the responses to the server; and 

an appliance component with apphance functionality. 

10. The apparatus of Claim 9, wherein the appliance component is an alarm 

clock. 

11- The apparatus of Claim 9, wherein the appliance component is a kitchen 
appliance. - 
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12. The apparatus of Claim 9, wherein the apph'ance component is an 
entertainment device. 

13. The apparatus of Claim 9, wherein the apparatus receives physiological 
data from a monitoring device coupled thereto. 

14. The apparatus of Claim 9, wherein the apparatus further comprises a 
monitoring device for generating physiological data. 



15. A medical monitoring device comprising: 

a user interface component for . interacting with an individual, said user interface 
component comprising: 

a communication component for receiving a script program from a server and for 
transmitting responses to the script program to the server over a commimications 
network, the script program comprises a set of queries; 

a user interface; and 

a processor connected to the conmiunication component and the user interface for 
executmg the script program to commumcate the set of queries to the individual to 
receive the responses to the set of queries from the user interface and to transmit the 
' responses to the server; and — 

a monitoring component for generating measurements of a physiological 
condition of the individual, 

wherein said generated measurements are transmitted by the communication 
component to the server over the communications network. 

16. The medical monitoring device of Claim 15, further comprises an 
apphance component with appliance frmctionality. 
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NUMBER: 9001 {LF} 
LED: 1 {LF} 

ZAP: {LF} 
CLS: {LF} 



93^ 




DISPLAY: ANSWER QUERIES NOW? 
^ . PRESS ANY BUTTON TO START ILF) 

\ WAIT:{LF} 

CLS: {LF} 
^ DISPLAY: HOW DO YOU FEEL? 

VERY VERY 
BAD BAD GOOD (300D {LF} 
INPUT: 0000 {LF} 

CLS: {LF} 

DISPLAY: HOW WELL ARE YOU 

MANAGING YOUR DISEASE? 
VERY VERY 
r WELL BADLY WELL WELL{LF} 

^ INPUT: 0000 {LF} 

CLS:{LF} 

DISPLAY: HOW HARD IS IT FOR YOU TO 

FOLLOW YOUR TREATMENT PLAN? 
VERY VERY 
HARD HARD EASY EASY {LF} 
INPUT: 0000 {LF} 

CLS: {LF} 

DISPLAY: HOW HARD IS IT FOR YOU TO 

CONTROL YOUR BLOOD SUGAR? 
VERY VERY 
HARD HARD EASY EASY {LF} 

f 
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INPUT: 0000 {LF} 
CLS: {LF} 

DISPLAY: CONNECT GLUCOSE METER 
AND PRESS ANY BUTTON 
WHEN FINISHED {LF} 

WAIT: {LF} 

CLS: {LP} 

DISPLAY: COLLECTENG MEASUREMENTS {LF} 
COLLECT: GLUCOSE_METER {LF} 
CLS: {LF} 

DISPLAY: CONNECT APPARATUS TO 

TELEPHONE JACK AND 

PRESS ANY BUTTON 

WHEN FINISHED {LF} 
WAIT: {LF} 

LED:0{LF} 
CLS: {LF} 

DELAY: 03:00 {LF} 

DISPLAY: CONNECTING TO SERVER {LF} 

CONNECT: {LF} 

{EOF} 
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